Development and Validation of a Scoring Rubric for Editorial Evaluation of Peer-review Quality: A Pilot Study.

Introduction: Despite the importance of peer review to publications, there is no generally accepted approach for editorial evaluation of a peer review's value to a journal editor's decision-making. The graduate medical education editors of the Western Journal of Emergency Medicine Special Issue in Educational Research & Practice (Special Issue) developed and studied the holistic editor's scoring rubric (HESR) with the objective of assessing the quality of a review and an emphasis on the degree to which it informs a holistic appreciation for the submission under consideration. Methods: Using peer-review guidelines from several journals, the Special Issue's editors formulated the rubric as descriptions of peer reviews of varying degree of quality from the ideal to the unacceptable. Once a review was assessed by each editor using the rubric, the score was submitted to a third party for blinding purposes. We compared the performance of the new rubric to a previously used semantic differential scale instrument. Kane's validity framework guided the evaluation of the new scoring rubric around three basic assumptions: improved distribution of scores; relative consistency rather than absolute inter-rater reliability across editors; and statistical evidence that editors valued peer reviews that contributed most to their decision-making. Results: Ninety peer reviews were the subject of this study, all were assessed by two editors. Compared to the highly skewed distribution of the prior rating scale, the distribution of the new scoring rubric was bell shaped and demonstrated full use of the rubric scale. Absolute agreement between editors was low to moderate, while relative consistency between editor's rubric ratings was high. Finally, we showed that recommendations of higher rated peer reviews were more likely to concur with the editor's formal decision. Conclusion: Early evidence regarding the HESR supports the use of this instrument in determining the quality of peer reviews as well as its relative importance in informing editorial decision-making.

Application of motor learning theory to teach the head impulse test to emergency medicine resident physicians.

Objectives: The objective was to develop an innovative method of training emergency medicine (EM) resident physicians to perform the head impulse test (HIT) component of the HINTS (head impulse test, nystagmus, test of skew) examination using video-oculography (VOG) device feedback. Methods: Using principles from motor learning theory and Ericsson's framework for expertise, we developed a training innovation utilizing VOG device feedback to teach the degree (10°-20°) and velocity (>100°/s) of head turn required for the HIT. We assessed the technical ability of participants to perform the HIT using the VOG device, without feedback, to count the number of successful HITs out of 20 attempts before, immediately after, and 2 weeks after the training innovation. Participants rated their confidence on a 1 to 5 Likert scale before and 2 weeks after training. Results: Most participants (11 of 14, 78%) were unable to perform even one successful HIT in 20 attempts before training despite brief verbal and visual instruction regarding the head turn parameters. However, most participants achieved more than one success, in fact, all with at least five successes, immediately after training (13 of 14, 93%) and again 2 weeks after training (nine of 11, 82%). The median (interquartile range) number of successful HITs was 0 (0, mean 0.79) during baseline testing, 7.5 (5.8) immediately after training, and 10 (8.0) 2 weeks after training (p < 0.01, Kruskal-Wallis). The median confidence rating increased from 1.5 (1) before baseline testing to 3 (1.5) after follow-up testing (p = 0.02, Mann-Whitney U). Conclusions: Prior to motor training, most participants failed to properly perform the HIT. Feedback training with VOG devices may facilitate development of the skills required to properly perform the HIT. Further study is needed to assess the ability to train the interpretive aspect of the HIT and other components of the HINTS examination.

A Collaborative Approach to Mentored Peer Reviews Sponsored by the Council of Residency Directors in Emergency Medicine.

Introduction: Historically, there have been no systematic programs for teaching peer review, leaving trainees to learn by trial and error. Recently, a number of publications have advocated for programs where experienced reviewers mentor trainees to more efficiently acquire this knowledge. Objective: Our goal was to develop an introductory learning experience that intentionally fosters peer-review skills. Methods: The Council of Residency Directors in Emergency Medicine (CORD) offered education fellowship directors the opportunity to mentor their fellows by reviewing submitted manuscript(s) supplemented by educational material provided by their journal. Reviews were collaboratively created. The decision letter that was sent to manuscript authors was also sent to the mentees; it included all reviewers' and editor's comments, as feedback. In 2022, fellows received a post-experience survey regarding prior experiences and their perspectives of the mentored peer-review experience. Results: From 2020-2022, participation grew from 14 to 30 education fellowships, providing 76 manuscript peer reviews. The 2022 survey-response rate of 87% (20/23) revealed that fellows were inexperienced in education scholarship prior to participation: 30% had authored an education paper, and 10% had performed peer review of an education manuscript. Overall, participants were enthusiastic about the program and anxious to participate the following year. In addition, participants identified a number of benefits of the mentored experience including improved understanding of the scholarship process; informing fellows' scholarly pursuits; improved conceptualization of concepts learned elsewhere in training; and learning through exposure to scholarship. Conclusion: This program's early findings suggest that collaboration between academic societies and interested graduate medical education faculty has the potential to formalize the process of learning peer review, benefitting all involved stakeholders.

The perceived work environment and well-being: A survey of emergency health care workers during the COVID-19 pandemic.

BACKGROUND: During the COVID-19 pandemic, health care provider well-being was affected by various challenges in the work environment. The purpose of this study was to evaluate the relationship between the perceived work environment and mental well-being of a sample of emergency physicians (EPs), emergency medicine (EM) nurses, and emergency medical services (EMS) providers during the pandemic. METHODS: We surveyed attending EPs, resident EPs, EM nurses, and EMS providers from 10 academic sites across the United States. We used latent class analysis (LCA) to estimate the effect of the perceived work environment on screening positive for depression/anxiety and burnout controlling for respondent characteristics. We tested possible predictors in the multivariate regression models and included the predictors that were significant in the final model. RESULTS: Our final sample included 701 emergency health care workers. Almost 23% of respondents screened positive for depression/anxiety and 39.7% for burnout. Nurses were significantly more likely to screen positive for depression/anxiety (adjusted odds ratio [aOR] 2.04, 95% confidence interval [CI] 1.11-3.86) and burnout (aOR 2.05, 95% CI 1.22-3.49) compared to attendings. The LCA analysis identified four subgroups of our respondents that differed in their responses to the work environment questions. These groups were identified as Work Environment Risk Group 1, an overall good work environment; Risk Group 2, inadequate resources; Risk Group 3, lack of perceived organizational support; and Risk Group 4, an overall poor work environment. Participants in the two groups who perceived their work conditions as most adverse were significantly more likely to screen positive for depression/anxiety (aOR 1.89, 95% CI 1.05-3.42; and aOR 2.04, 95% CI 1.14-3.66) compared to participants working in environments perceived as less adverse. CONCLUSIONS: We found a strong association between a perceived adverse working environment and poor mental health, particularly when organizational support was deemed inadequate. Targeted strategies to promote better perceptions of the workplace are needed.

In their own words: Experiences of emergency health care workers during the COVID-19 pandemic.

BACKGROUND: During the COVID-19 pandemic, a substantial number of emergency health care workers (HCWs) have screened positive for anxiety, depression, risk of posttraumatic stress disorder, and burnout. The purpose of this qualitative study was to describe the impact of COVID-19 on emergency care providers' health and well-being using personal perspectives. We conducted in-depth interviews with emergency physicians, emergency medicine nurses, and emergency medical services providers at 10 collaborating sites across the United States between September 21, 2020, and October 26, 2020. METHODS: We developed a conceptual framework that described the relationship between the work environment and employee health. We used qualitative content analysis to evaluate our interview transcripts classified the domains, themes, and subthemes that emerged from the transcribed interviews. RESULTS: We interviewed 32 emergency HCWs. They described difficult working conditions, such as constrained physical space, inadequate personnel protective equipment, and care protocols that kept changing. Organizational leadership was largely viewed as unprepared, distant, and unsupportive of employees. Providers expressed high moral distress caused by ethically challenging situations, such as the perception of not being able to provide the normal standard of care and emotional support to patients and their families at all times, being responsible for too many sick patients, relying on inexperienced staff to treat infected patients, and caring for patients that put their own health and the health of their families at risk. Moral distress was commonly experienced by emergency HCWs, exacerbated by an unsupportive organizational environment. CONCLUSIONS: Future preparedness efforts should include mechanisms to support frontline HCWs when faced with ethical challenges in addition to an adverse working environment caused by a pandemic such as COVID-19.

LIMEs and LEMONs: Critically Examining the Effect of a Blog Post on Junior Faculty Learners.

INTRODUCTION: The usage of asynchronous resources such as blogs and podcasts is pervasive in academic medicine, despite little understanding of their actual effect on learner knowledge acquisition. This study sought to examine the objective effect of a blog post on knowledge acquisition and application among junior faculty in emergency medicine (EM) via randomized controlled study. METHODS: All accredited EM residency programs in the United States and Canada were contacted to identify assistant and associate program directors and medical education fellows for recruitment into this study. Upon enrollment, participants were randomized as to whether they received access to a supplemental blog post prior to listening to a podcast episode. After listening to the podcast episode, all participants completed an assessment that included a test of knowledge application and knowledge acquisition; demographic information was also obtained. RESULTS: Ultimately, 103 participants completed the study; the study closed for enrollment in July 2019. Data were nonnormally distributed and groups were compared using the Wilcoxon rank-sum test. There were no significant differences between the demographics of the two groups nor was there a significant difference in knowledge between the two groups. CONCLUSION: The addition of a supplementary blog post did not increase junior faculty knowledge of a podcast episode.

Resident Research in Emergency Medicine: An Introduction and Primer.

Training in research methodology represents an important aspect of emergency medicine (EM) resident education, but best methods for design, implementation, and dissemination of resident research remain elusive. Here we describe recommendations and best practices from the existing literature on EM resident research, including helpful tips on how to best implement a resident research program.

An Asynchronous Curriculum for Teaching Practical Interpretation Skills of Clinical Images to Residents in Emergency Medicine.

BACKGROUND: Interpretation of radiologic images is a critical skill for resident physicians in emergency medicine (EM), however, few training programs offer formal training in this realm. Time and money also need to be considered when adding to the curriculum of trainees. OBJECTIVE: We sought to determine the utilization and benefit of an asynchronous curriculum in the interpretation of diagnostic imaging. METHODS: Radiologic images were obtained from emergency department patients and presented to the trainees on a weekly basis from April to December 2017; discussion questions regarding the images were posed, all via the online workplace platform Slack. Trainees were surveyed prior to and 8 months after initiation of the curriculum to ascertain their confidence with radiologic image interpretation and their use of Slack. RESULTS: Of the 36 potential resident physician participants in this study, 31 (86%) completed the pre-intervention survey and 28 (78%) completed the post-intervention survey. The curriculum was found to be beneficial to all respondents (100%) and increased their confidence with image interpretation from 2.93 ± 0.89 pre-intervention (5-point Likert scale) to 3.46 ± 0.83 post-intervention (p < 0.02). Seventy-five percent noted that they viewed the material "often" or "anytime new material was posted." CONCLUSIONS: Use of an asynchronous curriculum in image interpretation increased the confidence of trainees and was well-utilized. The implications of this are far-reaching, given that a similar intervention could be undertaken for any topic in any specialty in medicine, and with no cost of money or didactic time.

Misdiagnosis and failure to diagnose in emergency care: Causes and empathy as a solution.

Diagnostic error is the most frequent cause of allegations of negligence in emergency care in the United States and is estimated to contribute to the death of hundreds of thousands of patients worldwide each year. In this special contribution, we elucidate the cognitive mechanisms that emergency physicians use to make decisions and identify how these mechanisms can become sources of diagnostic error. The discussion centers on the appraisal of proposed methods to reduce the risk of diagnostic error, including debiasing strategies and a brief discussion of the theoretical basis for interventions to improve clinician empathy.

The Vice Chair of Education in Emergency Medicine: A Workforce Study to Establish the Role, Clarify Responsibilities, and Plan for Success.

OBJECTIVES: Despite increasing prevalence in emergency medicine (EM), the vice chair of education (VCE) role remains ambiguous with regard to associated responsibilities and expectations. This study aimed to identify training experiences of current VCEs, clarify responsibilities, review career paths, and gather data to inform a unified job description. METHODS: A 40-item, anonymous survey was electronically sent to EM VCEs. VCEs were identified through EM chairs, residency program directors, and residency coordinators through solicitation e-mails distributed through respective listservs. Quantitative data are reported as percentages with 95% confidence intervals and continuous variables as medians with interquartiles (IQRs). Open- and axial-coding methods were used to organize qualitative data into thematic categories. RESULTS: Forty-seven of 59 VCEs completed the survey (79.6% response rate); 74.4% were male and 89.3% were white. Average time in the role was 3.56 years (median = 3.0 years, IQR = 4.0 years), with 74.5% serving as inaugural VCE. Many respondents held at least one additional administrative title. Most had no defined job description (68.9%) and reported no defined metrics of success (88.6%). Almost 78% received a reduction in clinical duties, with an average reduction of 27.7% protected time effort (median = 27.2%, IQR = 22.5%). Responsibilities thematically link to faculty affairs and promotion of the departmental educational mission and scholarship. CONCLUSION: Given the variability in expectations observed, the authors suggest the adoption of a unified VCE job description with detailed responsibilities and performance metrics to ensure success in the role. Efforts to improve the diversity of VCEs are encouraged to better match the diversity of learners.

Coming in Warm: Qualitative Study and Concept Map to Cultivate Patient-centered Empathy in Emergency Care.

BACKGROUND: Increased empathy may improve patient perceptions and outcomes. No training tool has been derived to teach empathy to emergency care providers. Accordingly, we engaged patients to assist in creating a concept map to teach empathy to emergency care providers. METHODS: We recruited patients, patient caretakers and patient advocates with emergency department experience to participate in three separate focus groups (n = 18 participants). Facilitators guided discussion about behaviors that physicians should demonstrate to rapidly create trust; enhance patient perception that the physician understood the patient's point of view, needs, concerns, and fears; and optimize patient/caregiver understanding of their experience. Verbatim transcripts from the three focus groups were read by the authors, and by consensus, five major themes with 10 minor themes were identified. After creating a codebook with thematic definitions, one author reviewed all transcripts to a library of verbatim excerpts coded by theme. To test for inter-rater reliability, two other authors similarly coded a random sample of 40% of the transcripts. Authors independently chose excerpts that represented consensus and strong emotional responses from participants. RESULTS: Approximately 90% of opinions and preferences fell within 15 themes, with five central themes: provider transparency, acknowledgment of patient's emotions, provider disposition, trust in physician, and listening. Participants also highlighted the need for authenticity, context, and individuality to enhance empathic communication. For empathy map content, patients offered example behaviors that promote perceptions of physician warmth, respect, physical touch, knowledge of medical history, explanation of tests, transparency, and treating patients as partners. The resulting concept map was named the "Empathy Circle." CONCLUSIONS: Focus group participants emphasized themes and tangible behaviors to improve empathy in emergency care. These were incorporated into the Empathy Circle, a novel concept map that can serve as the framework to teach empathy to emergency care providers.

Development of a Case-based Reading Curriculum and Its Effect on Resident Reading.

Textbook reading plays a foundational role in a resident's knowledge base. Many residency programs place residents on identical reading schedules, regardless of the clinical work or rotation the resident is doing. We sought to develop a reading curriculum that takes into account the clinical work a resident is doing so their reading curriculum corresponds with their clinical work. Preliminary data suggests an increased amount of resident reading and an increased interest in reading as a result of this change to their reading curriculum.

Ocular Injuries: New Strategies In Emergency Department Management.

Ocular injuries are common in the emergency department, and they are the most frequent cause of noncongenital monocular blindness in children and adults. This review provides evidence-based recommendations for the diagnosis, treatment, and disposition of patients with all types of ocular trauma, including pain management, the use of antibiotics, cycloplegics, steroids, antifibrinolytics, and patching. Bedside ocular ultrasound has profoundly expanded diagnostic capability, particularly for the multiply injured patient, and routine management and disposition of patients with corneal abrasions has evolved significantly as well. Diagnosis and management of patients with retrobulbar hemorrhage is discussed in detail, with resources for performing vision-saving lateral canthotomy. Systematic evaluation and management of ocular trauma patients will ensure these patients have the best chance for a favorable final visual outcome.